Gesture and Musical Interaction: Interactive Engagement Through Dynamic Morphology
نویسنده
چکیده
New Interfaces for Musical Expression must speak to the nature of ‘instrument’, that is, it must always be understood that the interface binds to a complex musical phenomenon. This paper explores the nature of engagement, the point of performance that occurs when a human being engages with a computer based instrument. It asks questions about the nature of the instrument in computer music and offers some conceptual models for the mapping of gesture to sonic outcomes.
منابع مشابه
Generative Improv. & Interactive Music Project (GIIMP)
GIIMP addresses the criticism that in many interactive music systems the machine simply reacts. Interaction is addressed by extending Winkler’s [18] model toward adapting Paine’s [10] conversational model of interaction. Realized using commercial tools, GIIMP implements a machine/human generative improvisation system using human gesture input, machine gesture capture, and a gesture mutation mod...
متن کاملMachine Learning of Musical Gestures
We present an overview of machine learning (ML) techniques and their application in interactive music and new digital instrument design. We first provide the non-specialist reader an introduction to two ML tasks, classification and regression, that are particularly relevant for gestural interaction. We then present a review of the literature in current NIME research that uses ML in musical gest...
متن کاملPainting into Music: An interactive multimedia edutainment tool for painting
Interactivity is an integral part of engaging children with what they are learning. We address this engagement by creating an interactive entertainment and learning tool for children to use in the classroom or at home using a painting scenario. We do this by coalescing music, multimedia and electronics together through the real-time mapping of painting gestures into musical output and feedback....
متن کاملSonic Gestures as Input in Human-computer Interaction: towards a Systematic Approach
While the majority of studies in sonic interaction design (SID) focuses on sound as the output modality of an interactive system, the broad scope of SID includes also the use of sound as an input modality. Sonic gestures can be defined as sound-producing actions generated by a human in order to convey information. Their use as input in computational systems has been studied in several isolated ...
متن کاملA Method for Computer characterization of "Gesture" in Musical Improvisation
In the design of interactive computer music systems and the composition of interactive computer music, the tracking and analysis of musical "gestures" — characteristic motions discerned within musical attributes — provides a promising challenge. There are in fact ways that one can clearly and empirically define and identify "gesture" in musical content, often with conceptual models and tools si...
متن کامل